In the Drawings 

Replacement drawings Figs. 1-6 are submitted herewith to identify prior art (see 
Fig. 1) and to conform the drawings to include reference numeral designations 20, 30, 
40, 50, 60 and 70 that were added to the specification. No new matter has been added. 
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MARKED-UP SPECIFICATION 
METHOD AND COMPUTER SYSTEM FOR DESIGNING EXPERIMENTS 



FIELD OF THE INVENTION 

The present invention relates generally to^a method and a comput e r system for 
designing experiments , and to a corr e spond i ng comput e r program product, using a 
computer, and more particularly, using a computer to design experiments where the 
processing performed by the computer to design experiments includes evaluation of 
experimental data and data filtering. 

BACKGROUND OF THE INVENTION 

From In the prior art, it is known to design experiments by m e ans o f using 
statistical experiment designing design methods. Such d e sign i ng design methods are 
used, inter alia, to determine, with a minimum number of experiments, an empirical 
process model for the relationship between tbe-controlled variables and influencing 
variables in a process and for the resulting product properties and process properties. 
Such statistical experiment d e sign i ng design methods can be carr i od ou t performed , for 
example, using the "STAVEX" (STAtistical experiment designing with EXpert system 
produc e d by , manufacturer AICOS T e chno l og ie Technologies , Switzerland) computer 
program. A furth e r commercia ll y ava il able comput e r program for exp e riment d e s i gn i ng 
is4fre software program and software sold under the name "Statistica®" program mado 
by StatSoft (Europe) GmbH, Germany. 

^Various, different prior art experiment design technigues exist in the field of 
statistical experiment design i ng, var i ous e xp e riment des i gn i ng typ e s aro d i st i ngu i shed 
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i n tho pr i or art. In particu l ar, a d i stinction is mad e b e twoon tho design. All statistical 
experiment design methods originate from the classic- fully factorial method-att4 
mod e rn methods accord i ng to Taguch i or Shainin . Tho c l assic, fu ll y _ The factorial 
method is th e or i gin of a l l stat i stica l e xperiment d e s i gning methods. I t is bas e d on a 
5 compar i son of a ll compares all of the quality-conditioned factors with one another by 
analogy with variance analysis. Numorous var i ants hav e b ee n produc e d ov e r Over the 
course of the last few decades , numerous variants of the factorial method have been 
developed and validated in research and development laboratories. 

Modern experiment design methods according to Taouchi or Shainin are 

10 distinguishable from the classic, fully factorial methods. The Shainin DOE ( Design of 
Experiment ) ("DOE") method is a suitable proc e ss for proc e ss optimization process 
because it isolates what are ref e rr e d to known as -strong" influencing variables and 
i nv e st i gat e s thorn for performs processing to determine their relevance and dependence. 
The Taguchi DOE is based on pr e c e d i ng, prior art fractional factorial, orthogonal 

1 5 experiment designs. B e caus e of th e As ore-selecting the most important influencing 
variables achieves drastic savings in terms of experiment runs by pr e s e l e ct i ng th e most 
important i nf l u e nc i ng var i ab le s, this necessarv, the Tagauchi technigue is a rapid and 
relatively economic method of designing experiments and processes. 

Further known statistical experiment design type stechnigues of the fractional 

20 factorial experiment d e s i gns, design type include Plackett-Burmann experiment designs, 
central composite designs, boxBox-Behnken experiment designs, D-optimal designs, 
mixed designs, balanced block designs, Latin squares, and desperado designs (ofr-l* 
this r e sp e ct a l so see e.g. Eberhard Scheffler, Statist i sch e Statische Versuchsplanung 
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and ausw e rtung: ["statist i ca l exper i ment des i gn and ova l uat i on"1; und- Auswertunq. 
Deutscher Verlag fur Grundstoffindustrie, Stuttgart, 1997). 

Ewthe fAdditional methods for designing experiments are also known from Hans 
Bendemer, "Optimale Versuchsplanung" [Optimum experiment design], Reihe Deutsche 
5 Taschenbucher (DTB, Volume 23, and ISBN 3-87144-278-X) and Wilhem Kleppmann, 
Taschenbuch Versuchsplanung, "Produkte und Prozesse optimieren" [Optimize 
products and processes], 2nd expanded edition, ISBN: 3-446-21615-4. These methods 
are often used in practice for reasons of cost. 



10 that the processing associated with experiment d e s i gning design and modelling is 



■ tha t. Conseguentlv , under certain circumstances, no suitable optima are found and the 
reliability of the results and statements wh i ch ar e generated is questionable. A further 
significant disadvantage of pr e viously known prior art methods for designing 

15 experiments is that wh e n th e r e is , where a large number of influencing variables need to 
be taken into account, sa tethe prior art methods become too extensive. In addition, with 
respect to certain experimental systems, for example in catalysis or active ingredient 
research, the target function is often heavily -fractured- and4s A therefore, is difficult to 
capture with statistical methods. 

20 WO 00/4534 415341, incorporated by reference herein, discloses a method for 

developing solid catalysts for heterogeneous catalysed reaction processes, which is 
based on parallelized testing according to evolutionary methods. Corresponding 
methods which operate in an evolutionary way are also known from WO 00/4341 1, J. 



The disadvantage with known statistical methods for designing experiments is 




terformed without taking i nto account accounting for additional knowledge-se 
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chem. Inf. Compute. Sci. 2000, 40, 981-987 "Heterogeneous Catalyst Design Using 
Stochastic Optimization Algorithms" and from Applied Catalysis A: General 200 (2000) 
63-77 "An evolutionary approach in the combinatorial selection and optimization of 
catalytic materials" , each of which incorporated bv reference herein . 
5 In addition, US 6.009.379 U.S. Patent No. 6.009.379. incorporated bv reference 

herein, discloses a method for controlling a manufacturing process by means of an 
efficient experimental desiqn.-Hef e According to this patent , test points are distributed 
uniformly on a multidimensional spherical surface in order to b e ab le to w e iqht so that 
the individual manufacturing parameters can be weighted uniformly. 
10 Eiqwe FIG. 1 shows a block diagram of a syst e m, known from th e prior art 7 

system 20 for carry i ng out performing screening experiments,, such as is mav be used-ift 

« 

particu l ar in the fields of catalysis and material and active ingredient research.^Pbe 
syste m It is to be understood that each of the functional blocks of the system 20 
described below as performing data processing operations, as well as functional blocks 

15 of the systems described below and shown in the drawings as constituting 

embodiments of the present invention, constitutes a software module or, alternatively, a 
hardware module or a combined hardware/software module. In addition, each of the 
modules suitably contains a memory storage area, such as RAM, for storage of data 
and instructions for performing processing operations. Alternatively, instructions for 

20 performing processing operations can be stored in hardware in one or more of the 
modules. 

Referring to FIG. 1, the system 20 includes a substance library , that is to say 
what i s roferrod to module 1, such as a combinatorial library -l^aft dmodule, coupled to 



4 



an experiment set-up 2 for carry i ng out module 2. The module 2 is coupled to an 
experiment data module 3 and a data-driven optimizer 4. The optimizer 4 also is 
coupled to the library module 1 . The module 2 performs high throughput screening 
("HTS") or high speed experimentation ("HSE") experiments. Such screening 
5 experiments afe-typicallv are used for identifying active ingredients, catalysis research 
(homogeneous and heterogeneous), materials research and identification of optimum 
reaction conditions in chemical, biochemical or biotechnical systems. The optimizer 4 is 
a black-box optimizer which operates based on a data-driven model or on an 
evolutionary algorithm. The optimizer 4 does not have a priori knowledge of the 

10 structure and interactions concerning experiment design. The optimizer 4, instead, is 
restricted to the evaluation of the experiment data for purposes of selecting experiments 
stored at the combinatorial library module 1 . The black-box optimizer 4 is implemented, 
for example, by means of genetic algorithms, evolutionary algorithms or strategies, 
neural networks or other data-driven model approaches which rely on stochastic or 

15 deterministic optimization structures or optimization structures which are a combination 
of both the former and latter. 

Aln operation, the experiment set-up module 2 usually performs processing on a 
plurality of experiments ar e usua l ly carriod out in para llel i n such an oxpor i mont sot up 
2. Th e e xp e rim e nt r e su l ts ar e output i n th e form of a f ile 3. This output data, or somo of 

20 i t. is at th e samo timo the input data for an . The module 2 provides experimental results 
in the form of a data file to the experiment data module 3. At the same time, the module 
2 provides the experimental result data, or at least a portion thereof, as input data to the 
data-driven optimizer 4. The optim i zer A i s what is r e f e rred to as a black box 
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optim i z e rsr, that is to say an opt i m i z e r wh i ch is based on a data - dr i von model or on an 
e volutionary a l gor i thm. A prior i know le dg e of tho structure and/or interact i ons i s not 
pres e nt in th e opt i m i z e r 4 ; i nst e ad said optimizer A i s restr i cted to tho eva l uat i on of th e 
data as such in ord e r to mak e a s el ect i on of experiments from the comb i natoria l library 
5 1 Th e opt i mizer A typ i cal l y uses th e experiment data 3 composed o f in the module 3 
includes influencing variables-^ , such as attributes, factors, structure features, 
descriptors, physical variables T and properties of materials),, and data relating to the 
effect etthese variables have on what ar e referred to as targ e ts ( target variables)^ 
efde f. The optimizer 4 in performing its processing typically uses the experiment data 
10 stored in the module 3 to define an optimum search direction within the space of the 
tafoetsr target variables. 

Such a b l ack box opt i mizer 4 i s implemented, for e xamp l e, by m o ans of: 

15 gen e tic algor i thms, 

evo l ut i onary algor i thms or strat e gi e s, 

n e utral n e tworks or 

oth e r data dr i v e n mod el approach e s wh i ch r e ly on stochast i c or determin i st i c 

optim i zat i on structures or opt i m i zation structur e s which ar e a comb i nat i on of both 
20 of those. 

A common disadvantage of syeb-systems known from similar to the prior art 
system 20 is that a priori information cannot have an influence, or can only have a 
restricted influence, in the black-box optimizer 4, and corrosoonding such that search 
strategies often converge slowly T or converge on unsuitable suboptima. Such m e thods 
25 wh i ch are known from the Conseguently, prior art are thorefor e methods often are 
inefficient in terms of the expenditure of time and tbe-financial outlav.-Wttfr In addition, 
where experiment design techniques are based on evolutionary algorithms, there is atee 

6 
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tbea risk e fthat the expenditure and outlay b ei ng is higher when the optimizer is used to 
reach the optimum than when a rational or statistical procedure is used. 

The — invention — is — th e r e for e — bas e d — on — the — obj e ct — of — prov i d i ng — a& 
improv e d Therefore, there exists a need for a method and system for designing 
5 e xp e r i m e nts and a corr e spond i ng comput e r syst e m and comput e r program product. 

Th e obj e ct on wh i ch th e i nv e nt i on i s bas e d is r e sp e ct i v el y ach ie v e d by m e ans of th e 
f e atur e s of the ind e p e ndent pat e nt c l aims. Pr o f o rrod e mbodiments of th e i nv e ntion ar e 
g i v e n in th e d e p e nd e nt patent cla i ms. 

10 

Th e subj e ct matter of the i nvent i on is a m e thod for d e signing exp e rim e nts for ach i eving 
an opt i m i zat i on goa l having the fo ll owing st e ps: 

A) select i on of at le ast a first e xp e rim e nt from an experimenta l spac e by m e ans of a 

15 data driven opt i miz e r i n a comput e r un i t, 

B) i nputt i ng of e xp e r i m e nta ll y d e term i n e d e xp e rim e nt data of tho f i rst e xp e r i m e nt in 

at l oast ono mota l ayer into a computer unit, 

20 G) us e of at le ast on e m e ta l ay e r for tho eva l uation of tho oxporimont data, 

Q) i nputt i ng of th e e xp e rim e ntal l y d e t e rmin e d e xp e r i m e nt data of th e first e xp e rim e nt 

into the data dr i v e n optimiz e r, 

25 i nf l u e nc i ng of th e data dr i v e n optimiz e r by th e rosu l t of tho evaluation in th e mota 

lay e r and chocking tho goa l achieved, 

F) s ele ct i on of at l e ast a s e cond e xp e r i m e nt from the oxp e r i m e ntal spac e by m e ans 

of th e data driven opt i mizer, 

30 

G) r e pet i t i on of st e ps B) to E) for th e data of tho s o cond exper i m e nt, 
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H) stopping tho hoxat i on on achiov i ng the goa l or rep e ating st e ps A) to F) for at 

l oast a th i rd or subsequ e nt e xpor i monts unt il th e goa l has b e on aoh ie v e d. 

Tho method i s r e p e at e d unt il tho optim i zat i on goa l has beon achi e v e d or unt i l i t i s 
5 conc l ud e d that i t may not b e poss i b l e to aoh i ov e the opt i m i zat i on goa l . Tho method can 
bo term i nated automat i ca ll y or by tho user. Th e optim i zat i on goa l may bo to roach 
certa i n eva l uat i on characterist i c numbers for tho experiments. Th e character i stic 
numbers may, for e xamp l e, b e y iel d soloctiv i t i os, space t i me y i e l ds, costs, phys i cal 
prop e rt ie s, act i on m e chan i sms, d e r i v e d prop e rt ie s, e tc. I t is a l so poss i bl e to e va l uat e 

10 th e e xp e r i ments us i ng a p l ural i ty of charact e rist i c numb e rs.Th e inv e nt i on p e rm i ts 
know le dg e for inf l uenc i ng th e b l ack box optim i z e r to b e i nt e grated with tho object i v e of 
speed i ng up th e conv e rgence and/or ensur i ng conv e rg e nc e at a suitable opt i mum as 
w ell as experiments using a computer based system which improves convergence 
speed and ensure convergences at a suitable optimum while also increasing the 

15 reliability of the results. The know le dge may b e known h e r e a pr i ori as prior know le dg e 
and/or may b e supp l em e nt e d 

SUMMARY OF THE INVENTION 

In accordance with the present invention, method and system for designing 
experiments using a computer based system involves using knowledge associated with 

20 experimentation to influence processing at a data-driven optimizer. The knowledge 
includes a prior knowledge and supplementary knowledge obtained from continuously 
by-evaluating experiments wh i ch have b ee n carr ie d out previously performed 
experiments - 
Addit i onal know le dge is pr e f e rab l y generated her e i n the form of "rules", in 

25 part i cula r ln a preferred embodiment, a computer based system for designing 

experiments includes a meta layer module which uses a priori and supplementary 
obtained knowledge to influence processing operations at an optimizer, thereby 
effectively tuning the optimizer. The knowledge preferably includes rules associated 
with interactions, such as rules relating to-the structure-interaction with data mining and 
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other methods.^Phes e The rules can be integrated in the processing the optimizer 
performs for designing of th e e xp e rim e nt. experiments at to influence the optimizer 
processing before, during or after an optimization processing step, or even 
continuously , tho data dr i ven optimizer be i ng influ e nced corresponding l y. A m e ta l ayer 
5 is provided for i nfluencing th e data dr i von opt i m i z e r . 

Tho b l ack box optimizer i s tun e d by us i ng such a mota l ayor. In th i s context, tho m e ta 
l ayor i s not restr i cted to on e m e thod but rath e r may contain a comb i nat i on of various 
m e thods. Possible m e thods ar e : 

10 

n e ural n e tworks, 

hybr i d mod el , 

rigorous mod el s, 

data m i ning methods, for e xamo le ln a preferred embodiment the meta 

15 layer module can perform processing corresponding to the processing models 

associated with a neural network, a hybrid model, a rigorous model and data mining 

methods. The data mining methods can include a decision tree m e thods. method, a 

general separation methods. method, a subgroup search methods, method, a general 

partition methods, method, a cluster mothods. method, an association rule 

20 g e n e rators generator and ^correlation methods method . 

Th e m e thod of op e rat i on o f ln a preferred embodiment, the processing at the 

optimizer can bej s influenced diroctly here by i nt e rven i ng i n tho method of operat i on 

o fbv direct intervention with the processing operations performed by the optimizer, or 

indirectly by filtering the data which fefm forms the basis for the optimization processing 

25 performed bv the optimizer . 

According to on e ln another preferred embodimen t of th e i nv e nt i on, m e thods^ 

method for influencing the optimizer ar e us e d which tun e tunes the optimizer and/ef the 

optimization process. Such m e thods The tuning method can include, for example, a 
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subgroup search mothods o r method. correlation ana l yses o r analvsis and attribute 
statistics in the case of rule generators. 

Accord i ng to on eln a further preferred embodimen t of th e i nvent i on, further m e ta 
layers aro prov i ded wh i ch i mprove tho rocpoct i v ol y pr e c e d i ng m e ta l ayor or i ntervene in 

5 th e, the inventive system includes a plurality of meta laver modules, such that 
processing is improved in a preceding meta layer, intervention can occur in a preceding 
meta layer or layers and /or a l so i nt o rvone d i rect l y direct intervention can occur in the 
black-box optimization proc e ss of the f i rst le ve l processing performed at the optimizer . 
Accord i ng to ln still a further preferred embodiment of the invention, the 

10 intervention positions in the original optimization process and the methods or 
combinations of methods wh i ch ar e used in the meta lave r or lay e rs can b e (s) are 
varied in each optimization step. Tho ooloct i on o f In addition, selecting suitable 
methods for generating optimum rules can be carr ie d out performed automatically-hefe. 
Accord i ng to on e ln another preferred embodimen t of the inv e ntion , the optimizer 

15 is influenced by a re-evaluation of the-experiment data . For exampl e , tho oxpor i mont 
data itso l f can which already eentam contains an evaluation by virtu e of tho fact that . 
The experiment data can include an evaluation where appropriate experiment data, fef 
oxamplo th e such as yield data , is determined directly by oxpor i m e ntal moans. I n th i s 
cas e , th e experimentation. The re-evaluation can be carri e d out performed by filtering 

20 the yield data , for oxamp l o bv virtue of tho fact that . The method of filtering utilized is 
based on rules or other relationships which are determined based on an analytical 
method of processing experiment data, for example, processing methods associated 
with neural networks and data mining methods. Data filtering further increases the 
weighting of particularly good yields aro given a hoav ie r and further reduces the 

25 weighting by means of tho data filt e r i ng, and of particularly bad yields aro givon a lighter 
we i ghting bv moans of tho data f il ter i ng. A . thereby achieving a more rapid convergence 
of the experiment sequence can b e ach ie v e d by th e m e ans of th i s typo of data f i lt e r i ng . 

10 
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A corr e sponding proc e dur e can b e adopt e d i f ln an alternative embodiment where 
the experiment data does not directly contain an experimentally determined evaluation 
but rather the evaluation is determined only by moans of calculations which follow the 
experiment . I n th i s cas e, filtering or weighting is performed not on data which is 
5 determined experimentally but rather on evaluations which are determined by 
calculation. 

Tho method of f il tering resu l ts h e r e from ru le s or othor re l at i onsh i ps which havo boon 
found on th e bas i s of an analyt i ca l m e thod of tho oxp e r i m o nt data, for examp le by 
10 m o ans of noutra l n e tworks or data m i n i ng methods or othor methods. 

Accord i ng to| n a further preferred embodiment, the optimize r processing is 
influenced by reducing, enlarging afld/or displacing the experimental space. 

According to ln still a further preferred embodiment, the filtering i s oarr i od out by 
moans of proso l oot i on and/o r can include ore-selecting and weighting of the experiment 
15 data. Particularly -bad- experiment data, that i s to sav in other words, experiment data 
which has been recognized as unsuitable by, for example, a rule generator, is 



rule generator determines that corresponding parameters are irrelevant , entire columns 

or rows can also be eliminated from thean experiment data matri x if th o corr e sponding 
20 parameters havo boon r e cogn i zed as i rrelevant by tho rule generator. As a resu l t , 

thereby reducing the experimental space i s reduc e d, wh i ch and. in turn, considerably 

r e duo e s reducing the overall expenditure in terms of processing time . 

The weighting of the experiment data can bo we i ghted i n that exper i m e nt data 

which — is — recognized — as — bein ginclude duplicating particularly relevant \& 
25 dup li cat e d experiment data a single time or repeatedly in the experiment data matrix. 

Alternatively, the weighting can include introducing a weighting coefficient can b e 

introduc e d . 




ipre-selected and eliminated from the experimental space. In addition , if the 



Accord i ng to ono ln a further preferred embodiment of the invention, the black 

box opt i m i zer conta i ns what aro r o forrod to as core modules or core op e rators as w el l 

as a modol for so l ectina n e w tost po i nts. optimizer includes at least one core operator 

module and a module for selecting new test points. The method of operation of the 

optimizer is then influenced by influencing at least one of the core modu l o or modules 

and/or the module for selecting new test points based on relationships wh i ch havo boon 

recognized by, for example, a rule generator. 

DETA I LED DESCR IPTION BRIEF DESCRIPTION OF THE DRAWINGS 

Preferr e d embod i m e nts Other objects and advantages of the present invention 
will be nxp l nin e d i n moro detai l bo l ow w i th roforonc e to tho drawinqs. apparent from the 
following detailed description of the presently preferred embodiments, which description 
should be considered in conjunction with the accompanying drawings in which: 

Figur e 1 ohows a b l ock diagram represent i ng a systom for designing exper i m e nts 

wh i ch is known from tho pr i or art, 
FIG. 1 is a block diagram of a prior art system for designing experiments. 

Piqw eFIG. 2-shewsjs a block diagram of an embodiment of a system for 
designing experiments according to the present invention for des i gn i ng e xper i ments, , 

F-jqwe FIG. 3-showsjs a block diagram of an embodiment of thea system for 
designing experiments according to the present invention for design i ng exper i ments 
with- aincluding re-evaluation of the experiment data T . 

F i gur e A shew sFIG. 4 is a block diagram of an embodiment of thea system 

for designing experiments according to the present invention for designing oxporimonts 
w i th pr e s el oct i on and/o r including pre-selection and weighting of the experiment data 7i 
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Figur e 5 shew sFIG. 5 is a block diagram of an embodiment of thea system 

for designing experiments according to the present invention for des i gning e xper i m e nts 
wit frincluding influencing ef-the selection of new test points of tho optimizor. at the 
optimizer. 

5 

F i gure 6 shows 

FIG. 6 is a block diagram of an embodiment of thea system for designing 
experiments according to the present invention for d e s i gning o xp o rim e nts with 
i nf l uenc i ng of the cor e modu le or cor e modul e s of tho optim i zer. including influencing a 

10 core module of the optimizer. 

B RIEF DESCR I PT I ON OF THE DRAW I N GS DETAILED DESCRIPTION OF 

PREFERRED EMBODIMENTS 

FIG. 2 shows in block diagram form an embodiment of a system 30 for designing 
experiments in accordance with the present invention. Like reference numerals are 

1*5 used herein to describe system components having substantially similar and preferably 
identical, structure and operation as described previously. 

Th e system for design i ng e xp e r i m e nts in Figur e 2 is basod on Referring to FIG. 2, 
the system 20 includes a combinatorial library 5 which is formed based on the bas i s of 
the peripheral conditions giv e n by means of an e xp e rim e ntal spac e . From th i s 

20 comb i nator i al l ibrary 5. an corresponding to an experimental space. An experiment set- 
up module 7 is coupled to the library 5, an experiment data module 8 and a meta layer 
module 9. The module 9 includes an optimizer 6 and is coupled to the library 5. In 
operation, the optimizer 6 selects one or more experiments from the combinatorial 
library 5. which are then oarr i od out performed in afrthe experiment set-up module 7, for 

25 example^ by means of a high throughput screening or high speed experimentation 
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experiment method. The oorr o sponding experiment data io output i n tho form of a fi le 
8. I n th e syst e m for des i gning e xper i ments, a m e ta layor 0 i o prov i ded for tho opt i m i zer 
6. Tho m e ta lav e r 9 i s us e d to i nf l u e nc e th e opt i mizer 6 aenerated at the module 7 is 
provided in the form of a data file to the experiment data module 8. 
5 The meta laver module 9 influences processing at the optimizer 6 by taking into 

account a priori knowledge or knowledge acquired while the experiment is b e ing carr ie d 
out. Know le dge, for e xample in tho form of ru le s or i n th e form of train e d n e ural 
networks, can bo acquired h e r e continuous l y bv th e e va l uat i on of fil e s 8. performed. In a 
preferred embodiment, the optimizer 6 continuously evaluates the data stored as data 
10 files in the module 8 to acquire knowledge in the form of rules or trained neural 
networks. T he meta layer Qmodule 9, therefore A complements and influences 
processing at the data driven optimizer 6 by means o f providing additional knowledge m 
order to sp ee d up to the optimizer 6, thereby hastening convergence of the experiment 
series. 

The meta layer module 9 therefor e also permits improvement of the convergence 
speed of a black-box optimization method, which is implemented in the optimizer 6, te 
b e i mprov e d by integrating prior knowledge and/ef rule structures. This integration can 
be carr ie d out performed in various ways, for oxamp le such as by m e ans of : A ) 
information-supported additional selection of the test ensembles, i .e. rostriction which 
uses the rules found with data mining to restrict the portion of the combinatorial library_5 
to be tested by m e ans of th e rul e s found w i th data mining and no and does not involve 
intervention m toin the processing performed at the optimizer 6; B ^selective weighting 
of the optimization steps in the direction of library areas identified as optimum, kSrin 
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other words, intervention into the search method of the optimizer ^ 6; and C) tuning of 
the selection rules of the black-box optimization methods, ire rwhich involves direct 
intervention into the evaluation method of the optimizer^ or modification of the 
evaluation variables before boinq i nput i nto thev are provided to the optimizerThe 6. In a 
5 preferred embodiment, the forms of intervention A, B and C may bas i ca ll y a l so b e 
carr ie d out be performed in combination^-he r. For example, in an optimization step-it-is 
also poss i b le fo r , the interventions to bo carried out w i th can include A and B, B and C, A 
and C A or A and B and C. The intervention positions and intervention combinations as 
well as the methods use 4performed in the meta laye r module 9 may change from 
10 optimization step to optimization step. The interventions can-also can be carri e d 
ou tperformed from subsequent meta lavef slaver modules included in the experiment 
design system . 

When optimizing by means of statistical experiment design, the 
procodure processing performed is similar to th e us e o f that performed by a black-box 

1 5 optimize r, that i s to say h e r e too . The meta layer module 9 performs an intervention is 
carr i od out in the optimization process by m e ans of tho mota lay e r in one or more of the 
forms described above. For example, th e i ntegrat i on of prior knowledge is carr ie d out 
bv virtu e of tho fact that integrated when the influencing variables are selected , such that 
their field of validity and/of additional restrictions efon the field of validity are included in 

20 the combination of influencing variables. 

Further information on influencing variables may be included for the sequential 
statistical designing of experiments by using data mining methods or other methods 
described above T and i nt e grat e d integrating them into the processing for designing of 
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experiments . For example , that is to say the experimental space i smav be changed on 
the basis of the additional information after th e first, oocond n th path, 
r o sp e ct i v el v. an experiment design processing sequence is performed. The change is 
carr ie d out performed bya)- adding or removing influencing variablesbKchanging the 
5 fields of validity of the individual influencing variables or combined influencing 
variablesG K or a combination of a} the former and flatter . 

It is particularly advantag e ous l y h e r e advantageous that -prior art classic" 
methods for designing experiments which aro known from th e prior art can continue to 
be used ferat a black-box or a-statistical optimizer-^ . In accordance with the present 

10 invention, these methods for designing experiments are improved by m e ans of th e 
pr e s e nt invent i on by v i rtu e of th e fact that taking into account prior knowledge or 
knowledge acquired during the experiment sequence , which speeds up the 
convergence of the e xper i m e nts methods or actually permits the convergence of the 
exp e r i ments p e r so. I n particu l a r optimization methods per se. In a preferred 

15 implementation of the present invention , the convergence speed is considerably 
increased by tbe-tuning according to the invention when , for example, optimizing the 
d e s i gning design of experiments for catalysts, active ingredients or materials or reaction 
conditions. A further advantage is that the number of experiments can be reduced while 
the same results can be expected, thereby making possible tho low e r d e gr ee of a 

20 reduced expenditure in terms of time and materials and better utilization of the 
svstems. lt is also of part i cu l a r Another advantage isjhat integrating4he prior 
knowledge prevents loss of research investment when HSE or HTS technologies are 
used alone or in a combinatorial procedure. 
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F i gure 3 shows an ombod i mont of tho syst e m for design i ng oxp e rimonts i n wh i ch tho 
experiments are re evaluat e d. 

FIG. 3 shows a system 40 for designing experiments in accordance with an 

5 embodiment the present invention including experiment re-evaluation. Referring to FIG. 

3, the system 40 includes an experiment set-up module 7 coupled to an experiment 

data module 8, which in turn is coupled to an evaluation module 10. A meta layer 

module 9 includes a data analysis module 1 1 coupled to a rules and conditions module 

12, which is coupled to a re-evaluation module 13. The analysis module 11 is coupled 

10 to the experiment data module 8 and the evaluation module 10. A black-box optimizer 6 
is coupled to the re-evaluation module 13 and an experiment design module 14, which 
is coupled to the set-up module 7. 

Qft eThe system 40 operates as follows. The experiment set-up module 7 
performs one or more experiments which hav e b ee n previously selected from thea 

15 combinatorial library 5 (cf. F i gur e 2) ar e carried out in th e e xp e rim e nt s e t up 7. Th e 

correspond i ng fnot shown). The module 7 generates experiment data which is output in 
the form of tfrea data file to the module 8. The experiment data-may itself may already 
contain an evaluation befe-if appropriate data can bo is acquired directly by experimental 
means . An e xamp le of this i s , such as by the experimental determination of the-yieldv 

20 Th e y iel d which is at the same t i me an evaluation of the experiments carr ie d 
ou tperformed . 

I n oth e r cas e s A lternativelv, it may be necessary for an evaluation of the 
experiment data to be additionally performed in afrthe evaluation module 10. For 
example, the evaluation module 1 0 conta i ns performs a calculation rule for th e 
25 ca l cu l at i on o f process to calculate an evaluation based on one or more of the experiment 
data. The fil edata in the module 8 and, if appropriate, the result of the evaluation by the 
module 10 are i nput into provided to the meta laye r module 9. The meta l ay e r 9 
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contains a data analysis module 1 1 for i mpl o m o nt i nq in the module 9 can implement a 
data mining (DM) algorithm, a neural network^ a hybrid method or some other 
suitable data analysis method, Ru le s ar e a o n o rat o d The module 12 generates rules by 
applying such a m e thod, that i s to sav data analysis methods, for example, additional 
5 information and observations relating to the understanding of thea chemical system 
considered in the experiments. The module 1 1 therefore has th e function o f functions as 
a rule data generato r. Corrosponding ru l os and secondary cond i tions aro formu l at e d in 
th e modu le 12 of tho mota lavor 9. , and the module 12 formulates corresponding rules 
and secondary conditions. 

1 0 A ro evaluat i on of th e The module 13, if appropriate, re-evaluates an experiment 

or experiments i s th e n carr i ed out, i f appropriat e , i n th e modu l o 13^ based on the basis 
of th e s e rules and secondary conditions . Th i s can be carr ie d out i n such a way that a re 
ova l uat i on o f contained in the module 12. In a preferred embodiment, an experiment is 
carr ie d out re-evaluated only if a predefined threshold value is exceeded. Alternatively, 

15 the user can also-intervene i n ord e r to activate or deactivate the re-evaluation. The re- 
evaluation may consist in e xp e rim e nts which ar e r e cogniz e d as be i ng "poor" aro 
give ftinclude assigning a worse evaluation aftdto experiments wh i ch ar e recognized as 
being "good" are g i v e n poor and an improved evaluation . On th e bas i s of th e fi l oj o 
experiments recognized as being good. The optimizer 6 processes the data in the 

20 module 8, which, if appropriate, contains re-evaluated experiment data, th e b l ack box 
opt i m i z e r 6 th e n cr e at e s to create a further experiment design 18. Tho corr e spond i ng 
e xp e r i m e nts ar e th e n in turn carri e d out i n th e e xp e rim e nt s e t up. and so on. w hich is 
then representatively stored as data in the experiment design module 14. The 
experiment set-up module 7 then performs experiments corresponding to the 

25 experiment designs stored in the module 14. 

Eigw eFIG. 4 shows an alternative embodiment i n wh i ch tho fi l tering i s not carr i ed 
out by m e ans of a ro e va l uat i on of tho e xp e r i ment data, but rath e r by a prosoloot i on 
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af^/ofof a system 50 including the feature of filtering data by at least one of pre- 
selection and weighting. The system 50 for designing experiments i n F i gur e 4 has 
bas i ca ll y th e same des i gn h e r e as that i n F i gure 3, a modu le 15 for the proso l oct i on 
and/or w e ighting boing used i nstead of tho modul e 13.Tho experiment data i s therefor e 
5 not r e e va l uat e d or e va l uated differently, but i nst e ad the modu l o 15 can bo us e d, for 
oxamp l o. has essentially the same component configuration as the system 40. except 
that the re-evaluation module 13 is replaced by a module 15 for pre-selecting and 
weighting. Thus the system 50. unlike the system 40, does not re-evaluate the 
experiment data or evaluate the experiment data in a different manner Instead, in the 

10 system 50, the module 15 operates to eliminate experiments or give them greater or 
lesser weighting on th e basis of th e rul e s d e t e rm i n e d, based on the rule conditions 
stored in the module 12. A s a result, a pr e s e l e ct i on tak e s p l ac e pre-selection is 
performed without changing the actual evaluation of the experiments being chang e d . 
Figw eFIG. 5 shows a further embodiment of tbea system 60 according to the 

15 i nv e nt i on for d e sign i ng e xp e rim e nts. The ombod i mont i n F i gure 5 d i ffers from tho 

e mbod i m e nt in Figure 3 and F i gur e A i n that ther e is present invention. The system 60 is 
similar to the system 50. except that the system 60 does not include the module 15. In 
addition, the system 60 provides for direct intervention into the processing operations 
performed by the optimizer 6. I n this ombodimont. tho Referring to FIG. 5. the system 

20 60 includes an optimizer contains one or moro cor o modu le s 16, that is to say what ar e 
r e ferred to as coro op e rators. I n add i tion, th e opt i miz e r 6 contains 6 containing one or 
more core operator modules 16 i.e. parts of the program as functions in the algorithms 
e.g. Selection, calculation of gradients etc.). The module 16 is coupled to the evaluation 
module 10 and a module 17 for selecting new test points . Th o method of operat i on of 

25 th e modu le 17 i s i nf l u e nc e d by . which is also in the optimizer 6. Further, a post- 
selection module 18 is coupled to each of the modules 12. 14. 16 and 17. 
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In operation of the system 60, the rules and secondary conditions formulated by 
the module 12. that i s to oav. for oxamp l o. now tost 12 influence the processing 
performed at the module 17. For example, the module 17. based on the rules and 
secondary conditions data, rejects new test and points that have been selected by th e 
5 modulo 17 ar e r e j e cted so that thor e is a f ee dback from tho modu l o 17 to the coro 

modulo 16 i n ord e r to s e l e ct further, corr e sponding and that are not performing the rules 
out of module 12 and provides feedback data to the core module 16. The receipt of the 
feedback data at the core module 16 causes the core module 16 to select test points as 
replacements for the rejected test points. 

1 0 After the core module 16 performs actual optimization has occurrod i n tho coro 

modu l e 16 or coro modu l os 16, , the module 17, based on data received from the 
module 16, proposes new experiments or test points for optimizing the target variables 
of the system under consideration ar e th e r e fore propos e d by m e ans of th e modul e 17. 
This. The system mav-b ecan include , for example, a chemical, biotechnological, 

15 biological or enzymatic system. Expor i ments wh i ch contrad i ct the gen e rat e d ru l es ar e 
eli m i nat e d on th e basis of th e ru le s produced by moans of the rulo g e n e rator, that i s to 
say the mota layer 9, and i f appropriat e sa i d e xp e rim e nts ar e supp l em e nt e d w i th n e w 
e xp e rim e nts r el at i ng to tho optimizor, that is to say tho coro modul e 16 or coro modu le s 
16Th e el imination may b e carri e d out h e r e in a str i ct way, that is to say comp l et el y, or 

20 i n a soft wav. that is to sav with a c e rta i n d e gr ee The rule generator module 12 in the 
meta layer module 9, based on the rules data generated at the module 1 1 , eliminates 
experiments that contradict the rules formulated at the module 12. If appropriate, the 
core modules 16 of the optimizer 6 generate new, replacement experiments. The 
experiments can be eliminated completely or partially bv applying degrees of weighting. 

25 The module 17 then acts on these newly designed experiments must th e n a l so in turn 
pass through th e modu l o 17. This e nsur e s to ensure that information which is not, or 
cannot T be ± taken into account by the core modu le 16 or cor e modules 4£r16 is 
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subsequently integrated into the process of designing of experimentS T in the core 
modules 16. 

Alternatively, a soparate the post-selection module 18 can fol l o w processes data 
provided by the optimizer 6 i n ord e r to p e rform th e and performs post-selection of the 
5 new test points selected by the module 17. This corr e sponds to a t e st in th e The 

module 4-8 18, in other words, performs a test to determine whether the new test points T 
wh i ch hav e b ee n propos e d generated by the module 4^17 conform to the rulesr 
provided by the module 12. If test points are eliminated in this test, f ee dback i s in turn 
n e c e ssary in ord e r to d e s i gn corr e spond i ng the module 18 provides feedback data to the 

10 module 16 to cause the design of alternative new test points. 

Tho e mbod i m e nt of th e syst e m for d e signing e xp e r i m e nts i n Figur e 6 
corr e sponds to th e FIG. 6 is a system 70 for designing experiments in Figur e 5 with th e 
diff e r e nc e tha t accordance with the present invention which is substantially similar to the 
system 60, except that the module 18 is absent. Therefore, in the system 70, the 

15 method of operation of the module 17 is not influenced , nor do e s a by post-selection 
tak e p l ac e i n th e modu le 18, but rath e r processing and, further the method of operation 
of the core module 16 or core modu le s 16 of the optimizer 6 is influenced 
directly. Exampl e s o f In preferred embodiments, core operators of neural networks 
afe include and consider in the processing the type and number of influencing variables 

20 and the weighting of individual data points. Examp le s o f In addition, core operators of 
evolutionary algorithms tak i ng tho examp l e o f , such as the genetic algorithm ar e th e x 
include a selection operator {which provides for selection of a new series of 
experiments), the mutation operator and the cross-over operator. 

Theln operation of the system 70, the processing at the optimizer 6 accounts for 

25 the rules and information which ar e generated byat the rule generator ar e tak e n i nto 
account in the execution in tho a l gor i thm of tho actual optimizor.Fo r module 12. In a 
preferred embodiment including optimizers wh i ch ar e coupled to neural networks, this 
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m ea ns tha t the processing is based on the rules and operates to restrict the 
experimental space i s restricted by th e ru le s , or the processing weights the data records 
ar e w e ight e d in a particular way. 

WitbFor evolutionary algorithm optimizers, the core operators account for the 
5 additional information i s tak e n into account i n on e or moro coro operators. Th i s moans 
that, for o xamp lo . In a preferred embodiment , specific cross-overs, selections or 
mutations are prohibited or carr i od out performed with preference. For both types of 
opt i miz e r, th e r e su l t of th i s i s that when th o ro i s comp l oto automat i on of th e workflow, 
thefe-i soptimizers. intervention into the corr e spond i ng program parts processing portions 

10 of the optimizer-vi a, by way of interfaces T or the including information i s i nc l ud e d in the 
optimize r processing by means of manual or program-controlled changes of 
optimization parameters ^ results in complete automation of the workflow. 

Th e e mbod i m e nts i n F i gur e s 3 to 6 ln a preferred embodiment, the features of the 
systems 40 and 70 can be combined with one anothe r such that i s to say a plurality of 

15 rule g e n e rators, that is to say mota lay e rs 9, can b e generator modules, in other words, 
a plurality of meta layer modules, are integrated into the optimization sequence 
independently of one another. -Thes e The rules can b o g o n o rat o d generator modules 
generate the rules using various methods which ar e us e d i nd e p e nd e ntly of ono another, 
a^4, where the methods preferably are independent of one another, and the generated 

20 rules are combined in the module 12. The rules wh i ch hav e b e en formulated by the rule 
generator or ru le g e n e rators module of the meta Javer slaver module 9 are taken into 
account either automatically via bv way of defined interfaces and with compliance with 
predefined threshold values, or by means of manual formulation of rules for tho ar e a this 
part of the optimizer into which the rule generator intervenes. 
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L i st of ref e rence num e ra l s 



Comb i nator i a l li brary 4- 

Exporimont sot up 2- 

5 File a 

Opt i mizer 4 

Comb i nator i al li brary § 

Opt i miz e r § 

Exp e rim e nt s e t - up 7- 

10 File 8 

M e ta l ay e r 9 

Eva l uation modul e 4-0 

Modu le 44 

Modu le 45 

15 Modul e U 

Expor i mont design 44 

Modul e 45 

Core modu le 44 

Modul e Vf- 

20 Modu le 44 



Although preferred embodiments of the present invention have been described 
and illustrated, it will be apparent to those skilled in the art that various modifications 
may be made without departing from the principles of the invention. 
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